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DETAILED ACTION 

Response to Arguments 

In light of the fact that the Declaration filed on July 8, 2008 under 37 CFR 1 .131 
is ineffective to overcome the Higaki reference (2004/0028260 A1) as discussed below, 
Applicant's arguments with respect to claims 1-8 filed on July 8, 2008, which are all 
based on the invalidation of the Higaki reference, are, therefore, moot. 

Declaration Under 37 CFR 1.131 

The Declaration filed on July 4, 2008 under 37 CFR 1 .131 has been considered 
but is ineffective to overcome the Higaki reference (2004/0028260 A1). As stated in 
item 6 of the Declaration, Applicant failed to show due diligence as shown by the 
fact that the letter was misplaced and not found until after the time period for 
claiming foreign priority expired. Applicant merely asserts exercising due diligence in 
the Declaration under 37 CFR 1 .131 filed on July 4, 2008. However, as stated in the 
MPEP 715.07(a), "where conception occurs prior to the date of the reference but , but 
reduction to practice is afterward, it is not enough merely to allege that applicant or 
patent owner had been diligent Ex parte Hunter, 1 189 CD. 218, 49 O.G. 733 (Comm'r 
Pat. 1889). Rather, applicant must show evidence of facts establishing diligence." 
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A claim for priority under 35 U.S.C. 119(a)-(d) cannot be based on said 
application, since the United States application was filed more than twelve 
months thereafter. In this case, the U.S. filing date was April 1st, 2004, one day 
after the one year period. 

Specifically, foreign priority application JP 2003-094166 was filed in Japan on 
3/31/03, and the corresponding U.S. application was filed on 4/1/04. Given that one 
year from 3/31/03 is 3/31/04, and that 3/31/04 was a Wednesday, and not a federal 
holiday, the period for claiming foreign priority expired. 

The Declaration filed on July 4, 2008 under 37 CFR 1 .131 has been received, but 
fails to remedy the 1-day discrepancy of the U.S. filing date. Thus, the Declaration has 
been made of record, but does not serve to antedate any intervening references. 
Neither of these documents remedy the lapse in time, and therefore the Higaki 
reference (2004/0028260 A1) applied by the examiner in the previous Office Actions 
remains valid prior art under 35 U.S.C. 102(e). 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 
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(a) A patent may not be obtained though the invention is not identically disclosed or 
described as set forth in section 102 of this title, if the differences between the subject 
matter sought to be patented and the prior art are such that the subject matter as a 
whole would have been obvious at the time the invention was made to a person having 
ordinary skill in the art to which said subject matter pertains. Patentability shall not be 
negatived by the manner in which the invention was made. 

The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1 , 148 USPQ 459 
(1966), that are applied for establishing a background for determining obviousness 
under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 



Claims 1 is rejected under 35 U.S.C. 103(a) as being unpatentable over Higaki et. al. 
(US 2004/0028260 Al), in view of Kuno (5,802,494). 



In Regards to Claim 1 : 

Higaki discloses an image transmission system for a mobile robot, comprising: 
a camera for capturing an image as an image signal ("employing 2-color CCDs, with L 
and R denoting the left side camera and the right side camera respectively", Higaki, 
paragraph 41; Higaki, Figure 1, 1L and 1R). 



a microphone for capturing sound as a sound signal ("reference symbol 21 denotes a 
microphone that picks up the voice of a person speaking", Higaki, paragraph 41; Higaki, 
Figure 1, 21) 
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human detecting means for detecting a human from the captured image and/or sound 
("characteristic features such as the face and the hands of a person can be detected 
from the extracted outline information", Higaki, paragraph 13 and "voice recognition 
section which recognizes the content of the utterance picked up by the microphone", 
Higaki, paragraph 41). 

a power drive unit for moving the entire robot toward the detected human ("a drive 
control section", Higaki, paragraph 41; Higaki, Figure 1, 9); 

an image cut out means for cutting out an image of the detected human 

according to information from the camera ("reference symbol 54 denotes an outline 

extraction section which extracts an outline"; Higaki, Figure 1, 54) ; and 

wherein the human detecting means comprises: 

means for detecting a moving obiect as a human from the image signal 

obtained from the camera (Higaki. Fig.1, num. 58 and 59); 

means for extracting an outline of the moving obiect ( Higaki. Fig. 1, num. 54); 

means for extracting a face inside the outline of the moving obiect (Higaki. Fig. 6, S33); 

means for detecting a position of a hand by searching for a skin color area 

other than the face inside the outline of the moving object (Higaki. Fig. 6, S35); 

means for recognizing a gesture and/or posture of a human based on a 

positional relationship between the face and the hand (Higaki. Fig 6, S36 based on 

positional information gleaned from S33 and S35) : and 
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means for detecting a human according to the gesture and/or posture ("Reference 
symbol 71 denotes a setting file in which the relationships between human postures and 
corresponding instructions are pre-defined. Reference symbol 72 denotes a face 
database in which human facial recognition information is predefined. Reference symbol 
8 denotes a memory which stores the data necessary for posture recognition.", Higaki, 
paragraph 41). 

Higaki does not disclose an image transmitting means for transmitting a human image 
to an external terminal. 

Kuno (5,802,494) teaches an image transmitting means for transmitting a human image 
to an external terminal ("and the signals showing the subject's image are transmitted to 
a CRT display installed in a monitor room", column 1, lines 60-62, "the image of the 
subject's head is extracted from the input image (Figure 1 1 A)", column 9, lines 43-44) 

It would have been obvious at the time of the invention to a person of ordinary skill in 
the art to combine the image transmission system for a mobile robot with the elements 
as disclosed by Higaki with an image transmitting means for transmitting a human 
image to an external terminal taught by Kuno in order to monitor an individual from a 
remote location ("The CRT display displays the image of the subject, whereby a 
physician in the monitor room can observe the subject", Kuno, column 1, lines 22-24) 
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Claims 2, 4, 5, 6, and 7 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over tlie combination of Higaki et. al. (US 2004/0028260 A1) and Kuno (5,802,494) as 
applied to claim 1 . 

Regarding claim 2, the combination of Higal<i and Kuno teaches an image 
transmission system according to claim 1, wherein the system is adapted to determine 
that the moving object is a human from color information of the moving object ("mal<e an 
area inside the outline having a predetermined color a candidate for a hand of a 
person", paragraph 17, "denotes a face recognition section which recognizes a person's 
face from the color image, the skin-color area image", paragraph 19) 

Regarding claim 4, the combination of Higaki and Kuno discloses an image 
transmission system according to claim 1 , further comprising means for monitoring state 

variables including a current position of the robot; the image transmitting means 
transmitting the monitored state variables in addition to the cut out human image (FIG. 
28 is a diagram illustrating how to determine the position of the robot, column 3, lines 
16-17, "The physician looks at the subject's face being displayed on the display of the 
monitor console and also checks the physical conditions being displayed on the other 
displays of the console, in order to decide what he or she should do for the subject.", 
column 5, lines 26-30, "the circuit 40 starts transmitting the image data representing the 
image of the subject, to the monitor section 2", column 5, lines 14-16, "Meanwhile, the 
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electronics sensors 33 installed in the sickroom, such as the hemadynamometer and 
the electrocardiograph, both attached to the subject, output diagnosis signals, 
representing the physical conditions of the subject. The video signals and the diagnosis 
signals are input to the signal processor 32 incorporated in the data-processing/control 
section 4. The processor 32 processes these input signals, thereby generating image 
data and diagnosis data. The image data and the diagnosis data are supplied to the 
abnormality decision circuit 34 incorporated in the robot 5.", Kuno, column 5, lines 10- 
20) 

Regarding claim 5, the combination of Higaki and Kuno discloses an image 
transmission system according to claim 1, wherein the system is adapted to have the 
robot direct the camera toward the position of the detected human ("obtains the pan 
angle and tilt angle of the cameras 1 L and 1 R (step S81 ). The line of sight instruction 
section sends the obtained pan angle and the tilt angle to the action control section 9 
(step S82). As a result, the cameras 1 L and 1 R always come to face the direction of the 
head of the person who issues the instruction "come", it becomes possible to track the 
person", Higaki, paragraph 94) 

Regarding claim 6, the combination of Higaki and Kuno discloses an image 
transmission system according to claim 1, wherein the system further comprises means 
for measuring a distance to the detected human according to the information from the 
camera, and providing a target of a movement to said mobile robot ("a distance 
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calculation device that calculates a distance to the body being the candidate, from 
distance information of each pixel within the outline in the image", paragraph 12 and 
"the movement instruction section 64, based on the moving object data 90, tracks the 
person who instructed "come" (step S95)", Higaki, paragraph 95). 

Regarding claim 7, the combination of Higaki and Kuno discloses an image 
transmission system according to claim 1, wherein the image cut out means cuts out a 
portion of the image so that the portion of the image includes an image of the detected 
human, and the image transmitting means transmits only the cut out portion of the 
image to the external terminal ("and the signals showing the subject's image are 
transmitted to a CRT display installed in a monitor room", Kuno, column 1 , lines 60-62, 
"the image of the subject's head is extracted from the input image (Figure 1 1A)", Kuno, 
column 9, lines 43-44). 

Claim 3 is rejected under 35 U.S.C. 103(a) as being unpatentable over the combination 
of Higaki et. al. (US 2004/0028260 A1) and Kuno (5,802,494) as applied to claim 1 
above, and further in view of Shin ichi (2000-326274). 



In Regards to Claim 3: 
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While the Higaki Kuno combination discloses a microphone as described above, the 
Higaki and Kuno combination does not teach determining a direction of a sound source 
from the sound signal obtained from the microphone. 

However, ShinlchI does teach a system, in the same problem solving area of locating a 
source of sound, that detects the direction of a sound source ("direction of a sound 
source is detected", paragraph 5). 

It would have been obvious at the time of the invention to a person of ordinary skill in 
the art to combine the image transmission system for a mobile robot with the elements 
as disclosed by Higaki and Kuno in the claim 1 discussion above with a system as 
taught by Shinichi that is adapted to determine a direction of a sound source from the 
sound signal obtained from the microphone because this directional information 
provided by the sound signal allows the robot an additional way to be able to locate the 
person ("turned the robot in this direction" paragraph 5 of Shinichi and "person retrieval 
processing" paragraph 5 of Shinichi). 

Claim 4 is rejected under 35 U.S.C. 103(a) as being unpatentable over the combination 
of Higaki et. al. (US 2004/0028260 A1) and Kuno (5,467,403) as applied to claim 1 
above, and further in view of Ishii (6,278,904). 



In Regards to Claim 4: 
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Higaki, as part of the Higaki and Kuno combination applied to claim 1 above, teaches 
means for monitoring state variables ("the person information map 10 defines the 
relative position between the person and the autonomous relative position between the 
person and the autonomous robot R, in order to grasp where the person issuing 
instructions currently is. The person information map 110 includes: an individual person 
ID 1 1 1 for uniquely specifying persons, a relative position to self 1 12, a face object ID 
113, and individual person ID 1 14, a posture ID 1 15, a moving object ID 1 16, a face 
position coordinate 1 18 in the real space, a hand position coordinate 1 19, a distance to 
self 120, a relative angle to self 121 , an outline contact point coordinate 122, and a 
head vertex point coordinate 123", paragraph 87, "the operation for renewing the person 
information map in the object integration section 62 is described with reference to 
Figure 15", paragraph 88 and "the operation for renewing the person information map in 
the object integration section 62 is described with reference to Figure 15", paragraph 
88). 



Higaki does not disclose an image transmitting means transmitting the monitored state 
variable including current position of the robot. 



Ishii does disclose an image transmitting means transmitting the monitored state 
variables including the current position of the robot ("In the first embodiment, the 
information captured through the image sensor 1 1 and the audio sensor 12 is used for 
the purpose of detecting a current position of the robot 1 0 in order for the robot 1 0 to 
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move around all objects to be monitored or to monitor a specified object. The 
information captured through the image sensor 1 1 and the audio sensor 12 is also 
stored in the robot 10, or transferred externally through the communications device 19 
and stored in an external device, as the monitoring data", column 5, lines 10-15). 

It would have been obvious at the time of the invention to a person of ordinary skill in 
the art to combine the image transmission system for a mobile robot with the elements 
as disclosed by Higaki and Kuno in the claim 1 discussion above with an image 
transmitting means transmitting the monitored state variables including current position 
of the robot as taught by Ishii, in order to be able to observe a predetermined object and 
keep track of its location and other state variables of interest ("detecting a current 
position of the robot 1 0 in order for the robot to move around all objects to be monitored 
or to monitor a specified object" and "the information captured through the image sensor 
1 1 and the audio sensor 12 is also stored in the robot 10, or transferred externally 
through the communications device 19 and stored in an external device, as the 
monitoring data", Ishii, column 5, lines 10-15). 

Claim 8 is rejected under 35 U.S.C. 103(a) as being unpatentable over the combination 
of Higaki et. al. (US 2004/0028260 A1) and Kuno (5,467,403) as applied to claim 7. 

Regarding claim 8, the combination of Higaki and Kuno discloses an image 
transmission system according to claim 7, wherein the image cut out means cuts out the 
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portion of the captured image so that the portion of the image includes a face image of 
the detected human wherein the face image of the detected human occupies a 
substantially entire area of the cut out portion of the image ("and the signals showing 
the subject's image are transmitted to a CRT display installed in a monitor room", 
column 1 , lines 60-62, "the image of the subject's head is extracted from the input 
image (Figure 1 1A)", column 9, lines 43-44). 



Conclusion 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to ELISA M. RICE whose telephone number is (571)270- 
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1582. The examiner can normally be reached on 12:00-8:30p.m. EST Monday thru 
Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Vikkram Bali can be reached on (571)272-7415. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more Information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/Ellsa M Rice/ 
Examiner, Art Unit 2624 

/Vikkram Bali/ 

Supervisory Patent Examiner, Art Unit 2624 



